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ABSTRACT 

An  algorithm  is  given  for  solving  minimum-cost  flow  problems 
where  the  shipping  cost  over  an  arc  is  a  convex  function  of  the  number 
of  units  shipped  along  that  arc.  This  provides  a  unified  way  of  looking 
at  many  seemingly  unrelated  problems  in  different  areas.  In  particu¬ 
lar,  it  is  shown  how  problems  associated  with  electrical  networks,  with 
increasing  the  capacity  of  a  network  under  a  fixed  budget,  with  Laplace 
equations,  and  with  the  Max-Flow  Min-Cut  Theorem  may  all  be  formu¬ 
lated  into  minimum-cost  flow  problems  in  convex-cost  networks. 


INTRODUCTION 

Consider  a  connected  network  consisting  of  nodes  Nj  and  arcs  leading  from  Nj  to 
Nj .  Among  the  nodes  Nj ,  there  is  a  special  node  Ng  called  the  source,  and  a  special  node  Nt 
called  the  sink.  The  flow  from  N.  to  N.  in  the  arc  A^  is  denoted  by  .  If  it  is  possible  to 
have  flow  from  N^  to  Nj  or  from  Nj  to  Nj,  then  the  arc  A^  is  called  an  undirected  arc.  We 
consider  the  following  problem: 

(1)  Min  z  =  2  Cjjfy.) 

subject  to 


(2) 


f -v  for  j  =  s 


2  x.4  -  2  x4k  =  <  0  for  j  *  s,t, 
i  U  k  ]K 

v  for  j  =  t, 


where  Cjj(xjj)  are  non-negative  convex  functions  of  x^  ,  (Cjj(O)  =  0)  and  the  arc  flows  Xjj  are 
required  to  be  positive  integers  or  zero.  The  parameter  v,  which  is  required  to  be  a  non¬ 
negative  integer,  represents  the  total  flow  from  source  o  sink.  Note  that  Eqs.  (2)  express  the 

conservation  of  flow  at  nodes  other  than  the  source  and  the  sink.  2  xc4  is  the  outflow  of  N„ 

j  ®J  8 

and  2  x..  the  inflow  to  the  sink.  The  objective  function  (1)  is  a  sum  of  convex  functions  (not 
j  J 

necessarily  strictly  convex),  and  is  thus  convex. 


*This  manuscript  is  based  on  RAND  Report  RM-4265-PR.  Views  or  conclusions  contained  in 
this  paper  should  not  be  interpreted  as  representing  the  official  opinion  or  policy  of  the  U.S. 
Air  Force,  The  completion  of  this  manuscript  was  done  when  the  author  was  at  the  Univer¬ 
sity  of  California,  supported  by  The  Office  of  Naval  Research,  The  Army  Research  Office,  and 
The  National  Science  Foundation. 
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We  shall  discuss,  under  Applications,  how  this  problem  is  related  to  problems  of  find¬ 
ing  maximum  flow  in  a  network  with  arc-capacity  restrictions,  problems  in  the  synthesis  of 
traffic  or  communication  systems,  electrical-network  problems,  and  certain  boundary -value 
problems.  Similar  work  has  been  done  in  this  area  (see  [1,3,7,11]).  In  [3],  linear  cost  func¬ 
tions  Cij(xjj)  are  considered;  the  method  of  [1]  deals  with  bipartite  networks  and  starts  with  a 
feasible  solution. 

The  algorithm  presented  in^his  paper  deals  with  general  convex-cost  functions  in  an 
arbitrary  network  and  gives  a  feasible  solution  which  is  optimal  for  the  parameter  v.  In 
spirit,  it  is  closely  related  to  that  of  [1]  and  [3]. 

A  set  of  non-negative  x^  satisfying  (2)  is  called  a  flow  with  value  v.  A  flow  which 
minimizes  (1)  for  fixed  v  is  called  an  optimal  flow  corresponding  to  v.  Since  the  cost  of 
shipping  the  flow  along  an  arc  is  a  convex  function  of  the  amount  of  flow  shipped,  the  cost  of 
shipping  one  additional  unit  of  flow  along  the  arc  will  depend  on  how  much  flow  already  exists 
on  the  arc.  Following  Beale  [1],  we  define  the  so-called  "up-cost"  of  an  arc  as  follows.  For 
an  arc  A^  with  x^.  5  0  in  the  arc,  the  up-cost  of  that  arc  is  the  cost  of  sending  one  additional 
unit  of  flow  from  Nj  to  Nj ,  i.e., 

(3)  uij(xij>  =  cij(xij  +  !)  -  cij(xij)  for  xij  -  °- 

Suppose  we  want  to  send  one  unit  of  flow  from  Nfi  to  Nt  in  which  we  have  to  send  one 
unit  of  flow  from  N.  to  Nj  along  the  arc  A^  where  there  already  exists  x^  2:  0  in  the  arc; 
then  this  one  unit  of  flow  from  Nj  to  Nj  will  cancel  one  unit  of  x^ ,  hence  the  cost  of  sending 
one  unit  of  flow  from  Nj  to  Nj  is  actually  negative. 

We  shall  call  this  the  "down-cost"  of  an  arc;  i.e.,  the  cost  of  sending  one  unit  of  flow 
from  Nj  to  Nj.  In  symbols, 

(4)  W  =  -cij(xij)  +  cij*xij  ’  ^  f0r  xij  2  1* 

We  shall  assume  throughout  the  paper  that  Cjj(O)  *  0;  then  it  follows  from  the  convexity 
of  the  cost  functions  that 

cij(°)  +  tcij(xij  +  *)  "  cij(°))xij/(xij  +  l)  -  cij(xij)  for  xij  >  0 . 

Since  Cjj(0)  =  0,  we  have 


cij(xij  +  1)  ^  Ofy  +  1)  Cij(Xij)/Xij  • 

This  means  the  up-cost  of  an  arc  is  always  positive.  Similar  reasoning  shows  that  the  down 
cost  of  an  arc  is  always  negative.  Furthermore,  for  any  two  non-negative  integers  a  and  b 
with  a  <  b,  we  have 


(5) 

Ujj(a)  <  Ujj(b), 

(6) 

1  djj(a)  1  s  1  djj(b)  |  . 
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For  a  given  network  with  directed  and  undirected  arcs,  let  a  flow  with  value  Vj  be 
given  and  denote  its  arc  flows  by  x^ .  Let  another  flow  with  value  Vg  be  given  and  denote  its 
arc  flows  by  xj?) .  If  we  superpose  the  two  flows,  then  we  get  a  flew  with  value  v,  +  v2  •  Note 
that  if  Ay  is  a  directed  arc  and  having  arc  flow  Xy  >  0,  then  it  is  possible  to  superpose  a 
flow  with  arc  flow  Xy  >  0  provided  I  Xy  I  >  Ixyl 


(3)  _  X(D  .  x(2) 

ij  ‘  Xij  +  Xij 


) 


if  x 


(1) 

ij 


and  x 


(2) 

ij 


are  of  the  same  directions,  and 


i  *{/>  i 


i  x!?>, 


f 


if  xj|)  and  x|?^  are  of  the  opposite  directions  and  x|^  is  of  the  greater  magnitude.  We  say 
that  two  flow  patterns  are  conformal  if  and  only  if 


x(3)  .  x(l) 

xij  "  xij 


+  x 


(2) 

ij 


for  all  arcs. 

A  particular  flow,  called  a  "path  flow,"  is  a  flow  with  xsl  =  x12  =  . . .  =  xnt  =  1,  and 
Xy  ■  0  otherwise.  If  the  cost  of  a  flow  with  value  v  is  known  and  we  superpose  a  path  flow  on 
this  given  flow,  the  resulting  flow  has  value  v  +  1.  The  total  cost  of  the  resulting  flow  with 
value  v  +  1  is  the  sum  of  the  cost  of  the  flow  ,y»th  value  v,  plus  the  sum  of  Uy  and  dy  used 
in  the  path  flow.  Uy  is  used  if  the  arc  flow  of  the  path  flow  is  of  the  same  direction  as  that  of 
the  arc  flow  of  the  flow  with  value  v,  and  dy  is  used  if  the  two  arc  flows  are  of  opposite  di¬ 
rection.  The  sum  of  Uy  and  dy  used  in  the  path  flow  is  called  the  incremental  cost  of  the 
path  flow. 

ALGORITHM 

The  algorithm  for  solving  the  minimum-cost  flow  problem  in  convex-cost  networks  can 
be  simply  described  as  follows. 

Starting  with  all  Xy  =  0,  send  one  unit  of  flow  from  Ng  to  Nt  along  the  path  whose  in¬ 
cremental  cost  relative  to  the  existing  flow  is  minimum.  (This  can  be  done  by  any  of  the  exist¬ 
ing  shortest-path  methods  with  Uy  and  dy  as  the  lengths;  see,  for  example  [6,11].)  In  the 
beginning,  only  the  Uy  are  relevant  since  there  are  no  positive  arc  flows  which  could  be  po¬ 
tentially  cancelled.  Redefine  the  Uy  and  dy  based  on  the  new  flow  pattern  obtained,  a  d  send 
one  additional  unit  of  flow  along  the  path  with  minimum  incremental  cost.  The  process  of 
using  the  minimum  incremental  cost  path  is  repeated  until  the  total  outflow  of  Ng  is  v  (or  the 
total  inflow  of  Nt  is  v). 

Many  proofs  are  known  for  the  case  where  the  objective  function  (1)  is  a  linear  function. 
In  Beale  [1],  an  algorithm  is  given  for  a  bipartite  network  with  convex  costs,  and  it  starts  with 
a  feasible  solution.  It  is  easy  to  convert  the  existing  proofs  and  ideas  into  the  case  of  an  arbi¬ 
trary  network  and  convex-cost  functions,  and  to  show  that  at  every  successive  stage  of  the 
algorithm  the  flow  pattern  is  optimum  for  the  corresponding  parameter  v. 
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Let  us  give  one  example  to  illustrate  the  algorithm.  Consider  Figure  1.  The  cost 

2 

function  of  each  undirected  arc  is  c^  Xw ,  with  c^  written  beside  the  arc  and  c^  =  c^ .  As¬ 
sume  a  given  flow  pattern  as  shown  in  Figure  2. 


Then  the  up-costs  and  down-costs  of  every  arc  are  calculated  from  (3)  and  (4)  with  the 
result  shown  in  Figure  3,  where  the  first  number  beside  an  arc  is  the  up-cost,  the  second 
number  is  the  down-cost,  and  the  directions  of  up-costs  are  the  same  as  in  the  flow  pattern  of 
Figure  2.  For  example,  the  up-cost  of  A12  is  2x22  -  2x  l2  =  6.  If  an  arc  has  no  flow,  like 
As2  ,  the  cost  of  flow  from  both  directions  will  be  4x  l2  -  4x02  =  4.  If  we  want  to  send  one 
additional  unit  flow  with  minimum  Incremental  cost,  we  should  use  the  arcs  Ag2,  A21 ,  and 
with  total  incremental  cost  4  +  (-2)  +  4  =  6,  with  the  resulting  flow  pattern  as  shown  in 
Figure  4. 


APPLICATIONS 

Maximum- Flow  Min-Cut  Theorem 

The  problem  of  finding  maximum  flow  through  a  network  with  b^  as  the  capacities  of 
arcs  can  be  formulated  as  follows:  max  v  subject  to 
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(7) 


?  xii  •  i  x*  =  < 


r-v 
o 


for  j  =  s, 
for  j  *  s,  t, 
for  j  =  t, 


and 


(8) 


Osxtj<  bjj  for  all  i,  j . 


This  problem  can  be  formulated  as  a  minimum-cost  flow  in  convex-cost  networks  as  in 
(1)  and  (2).  The  cost  function  of  an  arc  is  shown  in  Figure  5.  The  up-cost  when  Xy  >  by  is 
not  defined  as  it  is  not  permitted  by  (8),  and  the  up-costs  and  down-costs  are  easily  seen  to  be 


VV  ■ 0 

if 

*ij 

w  * 0 

if 

xij 

w  -  * 

if 

xij 

< 


y 


>o, 


COST 


VALUE  OF 

h  ’  ARC  FLOW 

biJ 

Figure  5 


The  v  in  (2)  is  taken  as  a  parameter.  The  maximum  flow  v  is  obtained  when  the  value  of  the 
objective  function  z  becomes  infinity  for  v  +  1.  This  means  when  the  value  in  (2)  is  v,  there 
is  no  arc  in  the  network  with  infinity  cost,  and  when  the  value  is  v  +  1,  at  least  one  arc  is  with 
infinity  cost.  Since  we  are  minimizing  z,  there  must  be  a  set  of  arcs  which  form  a  cut  in  the 
flow  with  value  v  in  which  all  Xy  =  by .  Hence,  the  value  v  is  the  maximum-flow  value.  A 
proof  as  well  as  an  algorithm  is  shown  in  Busacker  and  Gowen  [3] .  We  can  generalize  the  ap¬ 
proach  used  in  [3]  to  solve  the  following  case: 

(9)  min  z  =  Z  Cy(Xy) 

subject  to 
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2  X,,  -  S  xilf 
i  ij  k  Jk 


=  < 


-v 

0 


i  =  s, 
i  *  M, 
j  =  t, 


(ID 


0<x, 


ij 


J 


where  in  (9)  z  is  a  sum  of  any  convex-cost  functions.  The  algorithm  of  always  choosing  the 
path  flow  with  minimum  incremental  cost  works  for  the  case  when  the  objective  function  is  a 
linear  function  (see,  for  example  [3]),  and  its  validity  does  not  depend  on  how  many  arcs  con¬ 
nect  the  two  nodes.  We  shall  transform  Eqs.  (9),  (10),  and  (11)  into  a  linear  case  as  follows. 

Consider  an  arc  as  a  set  of  arcs,  each  with  unit  capacity.  Index  those  arcs  with 
positive  integers  1,2,  . . . ,  p.  The  cost  of  the  k-th  arc  from  Nj  to  Nj  is 

ctj(k)  =  cij(k  -  1)  if  Xjj  =  0, 

and  the  cost  is  oo  if  Xjj  =  1.  It  follows  from  the  convexity  of  Cjj(xjj)  that  the  up-costs  of  arcs 
from  Nj  to  Nj  are  always  monotonically  increasing  with  the  index  of  the  arcs,  while  the  down- 
cost  of  the  k-th  arc  is  negative  if  it  has  flow.  Assume  that  >  0;  then  if  we  want  to  send 
additional  flow  from  Nj  to  Nj ,  we  always  use  the  arc  with  smallest  index  if  that  arc  is  not 
saturated;  if  we  want  to  send  flow  from  Nj  to  Nj ,  we  always  use  the  saturated  arc  with  largest 
index.  Then  (9)  becomes  a  set  of  linear  cost  functions  of  those  unit-capacity  arcs,  since  in  no 
case  would  we  use  an  arc  with  infinity  cost. 


Increasing  the  Capacity  of  a  Network 

This  problem  solved  in  [9]  can  be  stated  as  follows.  A  network  with  capacity  bjj  is 
given.  Now,  we  want  to  increase  the  capacity  or  construct  new  arcs  such  that  the  maximum 
flow  from  Ng  to  Nt  is  increased.  The  cost  of  increasing  or  constructing  a  unit  capacity  from 
Nj  to  Nj  is  Cjj .  The  problem  is  to  find  max  z  =  v  subject  to  c  =  2  Cjj  y^ 


2 

i 


xij  •  l  xjk  = 


r-v 

o 


for  j  =  s, 
for  j  s,t, 
for  j  =  t, 


0  <  x,4  <  b. 


ij  -  bij  +  *ij  • 


i.e.,  with  a  given  budget,  we  want  to  maximize  the  flow  from  Ng  to  Nt  by  allocating 
appropriately.  * 


*The  cost  function  on  yj;  is  like  Figure  5  with  the  vertical  line  replaced  by  an  inclined  arc 
with  slope  cjj . 
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This  problem  can  also  be  solved  by  the  algorithm  of  minimal  incremental  cost  path.  It 
follows  from  (3)  and  (4)  that  the  up-cost  and  down-cost  are: 


c 

H- 

n 

o 

if  Xy  <  by , 

uij<*ij>  ■  cij 

if  Xy  a  by  , 

W  -  0 

if  0  <  Xy  <  by  , 

<Vxij>  ■  "cij 

if  Xy  >  by . 

Then  the  solution  is  to  always  send  from  Ng  to  Nt  one  unit  of  flow  along  the  minimal  incre¬ 
mental  cost  path  (since  we  can  consider  the  problem  as  min  2  Cy  yy  and  treat  v  as  a  param¬ 
eter),  until  the  total  amount  of  money  used  up  is  c.  Then 

yij =  *ij  ■  bu  11  *1) 5  bu 

ylj?°  1'  *ij£b|j- 


Electrical  Network 

Consider  a  passive  electrical  network  with  one  current-input  source  at  Ng  and  one 
current-output  source  at  Nt.  From  Ohm's  law,  the  electrical  current  Xy  from  Nj  to  Nj  is 
proportional  to  the  potential  difference  <£y  and  inversely  proportional  to  the  resistance  ry  of 
that  arc;  i.e., 


2 

The  work  done  by  that  arc  is  Xy  #y  =  ry  Xy .  To  solve  an  electrical  network  of  the  preceding 
type,  we  can  solve  the  simultaneous  equations  given  by  Kirchoff's  node  law  and  Kirchoff's  loop 
law.  Alternatively,  we  can  regard  Kirchoff's  node  law  as  linear  constraints  of  the  currents 
Xy ,  and  minimize  the  total  work  done.  This,  then,  becomes  the  following  quadratic  program¬ 
ming  problem  (see  [5]):  min  z  *  2  ry  Xy  subject  to 


2  x 
i 


ij 


i  >  -  < 


r-y 
0 


for  j  =  s, 
for  j  *  s,t, 
for  j  =  t . 


This  problem  can  again  be  handled  by  the  minimum  incremental  cost-path  algorithm  by  defin 
ing  costs  of  arcs  as  follows.  Let 


Cij<xij> 


r  x2 
rij  xij 


thus 


* 
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UiJ<Xij)  =  rij(2xij  +  ^  i£  xij  “  0 » 

c£ji(xij)  =  "rij^xij  "  ££  xij  ~  ^  • 


Laplace  Equations 

The  consideration  of  a  network  problem  as  a  boundary-value  problem  was  done  in  [2] . 
Let  us  consider  the  Laplace  equation  in  a  region  G,  where  <p  is  a  function  of  two  real  varia¬ 
bles. 

(12)  V2  0  =  0 

with  the  normal  derivative  prescribed  on  the  boundary  of  G.  If  we  use  difference  equations  to 
replace  (12)  and  use  a  uniform  grid,  then  the  value  of  0q  at  a  point  is  the  average  value  of  its 
four  neighbors  (see  Figures  6  and  7);  i.e., 

(13)  40q  -  0j^  -  0g  -  0£  -  0^y  =  0. 


*NO 

X 

X,. 

OW 

EO 

*)S 

Figure  7 


By  rewriting  (13)  and  letting  xEq  =  0E  -  0 . ,  and  so  forth,  we  have 

(14)  xE0  -  xQW  +  xN0  -  xos  =  0 . 

Equation  (14)  then  can  be  considered  as  the  conservation-of-flow  equation,  with  xEq  the  arc 
flow  from  node  E  to  node  0.  The  boundary  condition  of  prescribing  a  0/S  n  is  then  interpreted 
as  the  condition  of  inflow  and  outflow  at  sources  and  sinks  in  a  network.*  The  Dirichlet  prin¬ 
ciple  (see,  for  example  [8] )  for  solving  a  Laplace  equation  can  then  be  regarded  as  that  of 
minimizing  a  quadratic  objective  function, 

(15)  min  z  =  S  Xjj, 

subject  to  Eq.  (14)  at  interior  points  of  region  G  and  satisfying  the  boundary  condition  x^  = 

3  0/3 n  at  the  boundary  of  G. 


*The  multiple  source  and  sinks  can  be  easily  transformed  into  one  source  and  one  sink.  See 
page  1 5  of  [8], 
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We  have  the  objective  function 


z 


I 


thus 


W  ■  2xij  ♦ 1 

if  x^  s  o , 

W  *  -2xij  ♦ 1 

if  x..  £  1 . 

Then  the  Laplace  equation  can  be  solved  by  min  incremental  cost  path  from  sources  to  sinks, 
as  done  previously.  Special  examples  can  be  given  to  show  that  this  approach  is  better.  De¬ 
tails  of  this  algorithm  and  numerical  examples  will  be  shown  in  [10]. 
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